Mejora del streaming de vídeo en DASH con codificación de bitrate variable mediante el algoritmo Look Ahead y mecanismos de coordinación para la reproducción, y propuesta de nuevas métricas para la evaluación de la QoE

[ES] Esta tesis presenta diversas propuestas encaminadas a mejorar la transmisión de vídeo a través del estándar DASH (Dynamic Adaptive Streaming over HTTP). Este trabajo de investigación estudia el protocolo de transmisión DASH y sus características. A la vez, plantea la codificación con calidad constante y bitrate variable como modo de codificación del contenido de vídeo más indicado para la transmisión de contenido bajo demanda mediante el estándar DASH. Derivado de la propuesta de utilización del modo de codificación de calidad constante, cobra mayor importancia el papel que juegan los algoritmos de adaptación en la experiencia de los usuarios al consumir el contenido multimedia. En este sentido, esta tesis presenta un algoritmo de adaptación denominado Look Ahead el cual, sin modificar el estándar, permite utilizar la información de los tamaños de los segmentos de vídeo incluida en los contenedores multimedia para evitar tomar decisiones de adaptación que desemboquen en paradas no deseadas en la reproducción de contenido multimedia. Con el objetivo de evaluar las posibles mejoras del algoritmo de adaptación presentado, se proponen tres modelos de evaluación objetiva de la QoE. Los modelos propuestos permiten predecir de forma sencilla la QoE que tendrían los usuarios de forma objetiva, utilizando parámetros conocidos como el bitrate medio, el PSNR (Peak Signal-to-Noise Ratio) y el valor de VMAF (Video Multimethod Assessment Fusion). Todos ellos aplicados a cada segmento. Finalmente, se estudia el comportamiento de DASH en entornos Wi-Fi con alta densidad de usuarios. En este contexto, se producen un número elevado de paradas en la reproducción por una mala estimación de la tasa de transferencia disponible debida al patrón ON/OFF de descarga de DASH y a la variabilidad del acceso al medio de Wi-Fi. Para paliar esta situación, se propone un servicio de coordinación basado en la tecnología SAND (MPEG's Server and Network Assisted DASH) que proporciona una estimación de la tasa de transferencia basada en la información del estado de los players de los clientes.[CA] Aquesta tesi presenta diverses propostes encaminades a millorar la transmissió de vídeo a través de l'estàndard DASH (Dynamic Adaptive Streaming over HTTP). Aquest treball de recerca estudia el protocol de transmissió DASH i les seves característiques. Alhora, planteja la codificació amb qualitat constant i bitrate variable com a manera de codificació del contingut de vídeo més indicada per a la transmissió de contingut sota demanda mitjançant l'estàndard DASH. Derivat de la proposta d'utilització de la manera de codificació de qualitat constant, cobra major importància el paper que juguen els algorismes d'adaptació en l'experiència dels usuaris en consumir el contingut. En aquest sentit, aquesta tesi presenta un algoritme d'adaptació denominat Look Ahead el qual, sense modificar l'estàndard, permet utilitzar la informació de les grandàries dels segments de vídeo inclosa en els contenidors multimèdia per a evitar prendre decisions d'adaptació que desemboquin en una parada indesitjada en la reproducció de contingut multimèdia. Amb l'objectiu d'avaluar les possibles millores de l'algoritme d'adaptació presentat, es proposen tres models d'avaluació objectiva de la QoE. Els models proposats permeten predir de manera senzilla la QoE que tindrien els usuaris de manera objectiva, utilitzant paràmetres coneguts com el bitrate mitjà, el PSNR (Peak Signal-to-Noise Ratio) i el valor de VMAF (Video Multimethod Assessment Fusion). Tots ells aplicats a cada segment. Finalment, s'estudia el comportament de DASH en entorns Wi-Fi amb alta densitat d'usuaris. En aquest context es produeixen un nombre elevat de parades en la reproducció per una mala estimació de la taxa de transferència disponible deguda al patró ON/OFF de descàrrega de DASH i a la variabilitat de l'accés al mitjà de Wi-Fi. Per a pal·liar aquesta situació, es proposa un servei de coordinació basat en la tecnologia SAND (MPEG's Server and Network Assisted DASH) que proporciona una estimació de la taxa de transferència basada en la informació de l'estat dels players dels clients.[EN] This thesis presents several proposals aimed at improving video transmission through the DASH (Dynamic Adaptive Streaming over HTTP) standard. This research work studies the DASH transmission protocol and its characteristics. At the same time, this work proposes the use of encoding with constant quality and variable bitrate as the most suitable video content encoding mode for on-demand content transmission through the DASH standard. Based on the proposal to use the constant quality encoding mode, the role played by adaptation algorithms in the user experience when consuming multimedia content becomes more important. In this sense, this thesis presents an adaptation algorithm called Look Ahead which, without modifying the standard, allows the use of the information on the sizes of the video segments included in the multimedia containers to avoid making adaptation decisions that lead to undesirable stalls during the playback of multimedia content. In order to evaluate the improvements of the presented adaptation algorithm, three models of objective QoE evaluation are proposed. These models allow to predict in a simple way the QoE that users would have in an objective way, using well-known parameters such as the average bitrate, the PSNR (Peak Signal-to-Noise Ratio) and the VMAF (Video Multimethod Assessment Fusion). All of them applied to each segment. Finally, the DASH behavior in Wi-Fi environments with high user density is analyzed. In this context, there could be a high number of stalls in the playback because of a bad estimation of the available transfer rate due to the ON/OFF pattern of DASH download and to the variability of the access to the Wi-Fi environment. To relieve this situation, a coordination service based on SAND (MPEG's Server and Network Assisted DASH) is proposed, which provides an estimation of the transfer rate based on the information of the state of the clients' players.Belda Ortega, R. (2021). Mejora del streaming de vídeo en DASH con codificación de bitrate variable mediante el algoritmo Look Ahead y mecanismos de coordinación para la reproducción, y propuesta de nuevas métricas para la evaluación de la QoE [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/169467TESI

Analysis and evaluation of adaptive LDPC AL-FEC codes for content download services

This paper proposes the use of adaptive low density parity check (LDPC) application layer-forward error correction (AL-FEC) codes for content download services over erasure channels. In adaptive LDPC codes, clients inform the content download server of the losses they are experiencing. Using this information, the server makes forward error correction (FEC) parity symbols available to the client at an optimum code rate. This paper presents an analytical model of the proposed adaptive LDPC codes. The model is validated through measurements realized with an application prototype. In addition, results show the performance of these codes in different scenarios, compared to the performance of nonadaptive AL-FEC, optimum LDPC AL-FEC codes, and an almost ideal rateless code. Adaptive LDPC AL-FEC codes achieve download times similar to almost ideal rateless codes with less coding complexity, at the expense of an interaction channel between server and clients.De Fez Lava, I.; Fraile Gil, F.; Belda Ortega, R.; Guerri Cebollada, JC. (2012). Analysis and evaluation of adaptive LDPC AL-FEC codes for content download services. IEEE Transactions on Multimedia. 60(3):641-650. doi:10.1109/TMM.2012.2190392S64165060

Proxy-based near real-time TV content transmission in mobility over 4G with MPEG-DASH transcoding on the cloud

[EN] This paper presents and evaluates a system that provides TV and radio services in mobility using 4G communications. The system has mainly two blocks, one on the cloud and another on the mobile vehicle. On the cloud, a DVB (Digital Video Broadcasting) receiver obtains the TV/radio signal and prepares the contents to be sent through 4G. Specifically, contents are transcoded and packetized using the DASH (Dynamic Adaptive Streaming over HTTP) standard. Vehicles in mobility use their 4G connectivity to receive the flows transmitted by the cloud. The key element of the system is an on-board proxy that manages the received flows and offers them to the final users in the vehicle. The proxy contains a buffer that helps reduce the number of interruptions caused by hand over effects and lack of coverage. The paper presents a comparison between a live transmission using 4G connecting the clients directly with the cloud server and a near real-time transmission based on an on-board proxy. Results prove that the use of the proxy reduces the number of interruptions considerably and, thus, improves the Quality of Experience of users at the expense of slightly increasing the delay.This work is supported by the Centro para el Desarrollo Tecnologico Industrial (CDTI) from the Government of Spain under the project "Plataforma avanzada de conectividad en movilidad" (CDTI IDI-20150126) and the project "Desarrollo de nueva plataforma de entretenimiento multimedia para entornos nauticos" (CDTI TIC-20170102).Arce Vila, P.; De Fez Lava, I.; Belda Ortega, R.; Guerri Cebollada, JC.; Ferrairó, S. (2019). Proxy-based near real-time TV content transmission in mobility over 4G with MPEG-DASH transcoding on the cloud. Multimedia Tools and Applications. 78(18):26399-26425. https://doi.org/10.1007/s11042-019-07840-6S2639926425781

Transmisión inalámbrica multimedia coordinada con DASH-SAND

[EN] The adoption of DASH (Dynamic Adaptive Streaming over HTTP) as a video transmission standard has introduced new challenges in environments with high density of Wi-Fi clients. If video players do not take into account the playback status of other devices in the network unfair bandwidth distribution may cause playback problems (stalls, low playback quality, etc.). This paper proposes a collaborative playback technique based on DASH-SAND (MPEG¿s Server and Network Assisted DASH) that aims to reduce, in a collaborative way, the number of interruptions in the playback of multimedia content in Wi-Fi environments with high density of users. Results prove that the proposed solution reduces both the number and duration of stalls at the expense of decreasing the average representation of the playback.Este trabajo ha sido subvencionado por el Programa PAID10-18 así como por el Proyecto Línea de I+D+i Tecnologías de distribución y procesado de información multimedia y QoE de la Universitat Politècnica de València.Belda Ortega, R.; De Fez Lava, I.; Guerri Cebollada, JC. (2020). Transmisión inalámbrica multimedia coordinada con DASH-SAND. Universidad de Málaga. 1-4. http://hdl.handle.net/10251/178577S1

Android real-time audio communications over local wireless

This paper describes an Android mobile application that allows voice communications through short-range wireless networks, mainly Bluetooth and Wi-Fi. The application is able to replicate as close as possible the behavior of a two-way radio device. The application is designed to receive audio streams from multiple devices simultaneously and to send them. The main design considerations of the application, such as audio recording and playing, audio coding or data transmission, are explained through the paper.Belda Ortega, R.; Arce Vila, P.; De Fez Lava, I.; Fraile Gil, F.; Guerri Cebollada, JC. (2012). Android real-time audio communications over local wireless. Waves. (4):35-42. http://hdl.handle.net/10251/57677S3542

Uso de contenedores Docker en el entorno educativo

[EN] The use of different software programs in the realization of laboratory practices usually entails problems for both teachers and students, due to the fact of carrying out the installation and maintenance of the programs, which sometimes tend to present compatibility problems derived from updates. This article proposes the use of Docker, a tool that provides an execution environment that contains all the programs to be used in a practice, thus facilitating the generation of learning environments. Moreover, this work presents a real experience in the use of the aforementioned tool carried out over three courses in a subject with practical exercises in the field of Telecommunications and Information Technologies, detailing the advantages and drawbacks that the use of Docker has meant for both faculty and students.[ES] La utilización de diferentes programas software en la realización de prácticas de laboratorio suele conllevar problemas tanto para el profesorado como para el alumnado, por el hecho de llevar a cabo la instalación y mantenimiento de los programas, los cuales a veces suelen presentar problemas de compatibilidad derivados de actualizaciones. En este artículo se propone el uso de Docker, herramienta que permite disponer de un entorno de ejecución que contiene todos los programas a utilizar en una práctica, facilitando así la generación de entornos de aprendizaje. Asimismo, en este trabajo se presenta una experiencia real de uso de dicha herramienta, llevada a cabo a lo largo de tres cursos en una asignatura de prácticas del campo de las Telecomunicaciones y las Tecnologías de la Información, detallando las ventajas e inconvenientes que el uso de Docker ha supuesto tanto para el profesorado como para el alumnado.De Fez Lava, I.; Arce Vila, P.; Belda Ortega, R.; Guerri Cebollada, JC. (2021). Uso de contenedores Docker en el entorno educativo. En IN-RED 2021: VII Congreso de Innovación Edicativa y Docencia en Red. Editorial Universitat Politècnica de València. 905-915. https://doi.org/10.4995/INRED2021.2021.13800OCS90591

Performance evaluation of AL-FEC LDPC codes for push content applications in wireless unidirectional environments

The final publication is available at Springer via http://dx.doi.org/10.1007/s11042-011-0841-yFEC (Forward Error Correction) mechanisms improve IP content transmission reliability through the recovery of packets lost in transmission. Opposite to ARQ (Automatic Repeat Request), FEC mechanisms are especially suited to unidirectional environments or to multicast environments where multiple receivers perceived different channel losses, thus making difficult the implementation of mechanisms based on feedback information. Among the different types of FEC codes, this paper presents a thorough performance evaluation of LDPC (Low Density Parity Check) codes, based on an implementation developed by the authors, according to the specifications defined by RFC 5170 for the usage of LDPC codes by push content applications based on the FLUTE protocol. LDPC codes provide a good trade-off between performance and complexity, hence, they are appropriate for mobile applications. Contributions of this paper include tests conducted with commercial mobile phones connected to the push content download server over a Wi-Fi network. The evaluation highlights the advantages of using packet level FEC encoding in file transmission over unidirectional networks and provides with a comparison between two kinds of LDPC structures: Staircase and Triangle. This is accomplished by calculating the inefficiency ratio of these LDPC structures in different environments. Results show that the implemented LDPC codes can provide inefficiency ratios close to one when the different coding parameters (as the code rate or the number of blocks) are configured to an optimal value that depends on the packet loss rate. © 2011 Springer Science+Business Media, LLC.This work was supported in part by the Ministry of Industry, Tourism and Trade of the Government of Spain, under project "Redes Hibridas para la Provision de Servicios Turisticos" (TSI-020302-2010-165).De Fez Lava, I.; Fraile Gil, F.; Belda Ortega, R.; Guerri Cebollada, JC. (2012). Performance evaluation of AL-FEC LDPC codes for push content applications in wireless unidirectional environments. Multimedia Tools and Applications. 60(3):669-688. https://doi.org/10.1007/s11042-011-0841-yS6696886033GPP TS 22.146 (2006) Multimedia broadcast/multicast service; stage 1 (release 6), V6.7.03GPP TS 25.346 (2007) Introduction of the Multimedia Broadcast Multicast Service (MBMS) in the Radio Access Network (RAN); Stage 2 (Release8), V8.0.0Bai H, Atiquzzaman M (2003) Error modeling schemes for fading channels in wireless communications: a survey. IEEE Comm Surv Tutorials 5(2)Cunche M, Roca V (2008) Optimizing the error recovery capabilities of LDPC-staircase codes featuring a Gaussian elimination decoding scheme. Proc. of the 10th IEEE International Workshop on Signal Processing for Space Communications (SPSC), Rhodes Island, GreeceCunche M, Roca V (2008) Improving the decoding of LDPC codes for the packet erasure channel with a hybrid Zyablov iterative decoding/Gaussian elimination scheme. INRIA Research Report RR-6473Cunche M, Savin V, Roca V (2010) Analysis of quasi-cyclic LDPC codes under ML decoding over the erasure channel. IEEE International Symposium on Information Theory and its Applications (ISITA), Taichung, TaiwanFaria G, Henriksson J, Stare E, Talmola P (2006) DVB-H: digital broadcast services to handheld devices. Proc IEEE 94(1):194–209Fraile F, de Fez I, Guerri JC (2011) Evaluation of a background push download service for personal multimedia devices. IEEE International Conference on Consumer Electronics, Las Vegas, USAGallager R G (1962), Low density parity check codes. IEEE Trans Inform Theor 8(1)Gil A, Fraile F, Ramos M, de Fez I, Guerri JC (2010) Personalized multimedia touristic services for mobile hybrid broadband/broadcast. IEEE Trans Consum Electron 56(1):129–211Handley M, Jacobson V (1998) SDP: session description protocol. IEFT RFC 2327IEEE (2007) Std. 802.11, wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) specificationsIEEE (2009) Std. 802.16, air interface for broadband wireless systemsLacan J, Roca V, Peltotalo J, Peltotalo S (2009) Reed-Solomon Forward Error Correction (FEC) schemes. IETF RFC 5510Luby M (2002) LT codes. Proc. IEEE Symposium on Foundations of Computer Science (FOCS), Vancouver, CanadaLuby M, Shokrollahi A, Watson M and Stockhammer T (2007) Raptor forward error correction scheme for object delivery. IETF RFC 5053Luby M, Watson M, Vicisano L (2009) Layered Coding Transport (LCT) building block. IEFT RFC 5651Luby M, Watson M, Vicisano L (2010) Asynchronous Layered Coding (ALC) protocol instantiation. IEFT RFC 5775MacKay D, Neal R (1995) Good codes based on very sparse matrices. In 5th IAM Conference: Cryptography and Coding, LNCS No. 1025Paila T, Luby M, Lehtonen R, Roca V, Walsh R (2004) FLUTE—file delivery over unidirectional transport. IETF RFC 3926Park S, Miller K (1990) Random number generators: good ones are hard to find. Commun ACM 33(1):87–88INRIA Planète Research Team (2006) LDPC large block FEC codec distribution, http://planete-bcast.inrialpes.fr/article.php3?id_article=16Roca V, Neumann C (2004) Design, evaluation and comparison of four large block FEC codecs, LDPC, LDGM, LDGM staircase and LDGM triangle, plus a Reed-Solomon small block FEC codec. INRIA Research Report RR-5225Roca V, Neumann C, Furodet D (2008) Low Density Parity Check (LDPC) Staircase and Triangle Forward Error Correction (FEC) schemes. IETF RFC 5170Shokrollahi A (2006) Raptor codes. IEEE Transactions on Information Theory no. 6Watson M (2009) Basic Forward Error Correction (FEC) schemes. IETF RFC 5445Watson M, Luby M, Vicisano L (2007) Forward Error Correction (FEC) building block. IETF RFC 5052White Paper (2009) Integrated Mobile Broadcast (IMB): the power of predictive broadcasting for 3G multimedia application

A power consumption monitoring, displaying and evaluation system for home devices

[EN] This paper presents an implementation of a smart meter monitoring system based on Arduino platform and accessible from Android mobile devices. On the one hand, it has been developed a measure device, based on Arduino, which monitors the power consumption from each home device and sends this information to a server. On the other hand, users can see by means of their mobile devices the power consumption in real time. Also, users can know the detailed consumption from previous months. This way, the developed application is aim to satisfy two different consumer needs: improve their economy and their sustainability in the way electrical power is consumed.Miquel Murcia, A.; Belda Ortega, R.; De Fez Lava, I.; Arce Vila, P.; Fraile Gil, F.; Guerri Cebollada, JC.; Martínez Zaldívar, FJ.... (2013). A power consumption monitoring, displaying and evaluation system for home devices. WAVES. 5:5-13. http://hdl.handle.net/10251/52792S513

Algoritmo de adaptación DASH: Look Ahead

La transmisión de vídeo por Internet ocupa el primer puesto de consumo de ancho de banda y la previsión es que continúe siendo la principal fuente de tráfico en Internet. Entre los diferentes mecanismos de transmisión de vídeo existentes en la actualidad destaca DASH, debido a su fácil integración con CDNs (Content Delivery Network) y a su capacidad de atravesar firewalls y NATs. Este estándar surgió hace pocos años, por lo que está todavía en fase de desarrollo. En este sentido, esta tesina presenta una implementación de un cliente de vídeo DASH para la plataforma Android. Asimismo, la tesina evalúa las implicaciones de la codificación de vídeo con bitrate variable en el algoritmo de adaptación y propone un algoritmo que tiene en cuenta esta información con el objetivo de evitar interrupciones en la reproducción.Video transmission over the Internet ranks first of bandwidth consumption and the previsions say it will remain the main source of Internet traffic. Among the different transmission mechanisms exist today video DASH stands out because of its easy integration with CDNs (Content Delivery Network) and its ability to traverse firewalls and NATs. This standard emerged a few years ago, so it is still under development. In this sense, this thesis presents an implementation of a DASH video client for the Android platform. Furthermore, the thesis assesses the implications of variable bitrate video encoding to the adaptation algorithm and proposes an algorithm that takes into account this information in order to avoid interruptions in playback.Belda Ortega, R. (2013). Algoritmo de adaptación DASH: Look Ahead. http://hdl.handle.net/10251/33359.Archivo delegad

New objective QoE models for evaluating ABR algorithms in DASH

[EN] As users become more demanding with regards to the consumption of multimedia content, the importance of measuring their level of satisfaction is growing. The difficulty in terms of time and resources for assessing the Quality of Experience (QoE) has popularized the use of objective QoE models, which try to emulate human behavior regarding the playback of multimedia streaming. Some objective QoE models existing in the literature are based on the bitrate. However, the PSNR (Peak Signal-to-Noise Ratio) or VMAF (Video Multimethod Assessment Fusion) have been proved to be metrics with a closer relationship with the QoE than the bitrate. This paper proposes three new models to measure the QoE analytically in DASH (Dynamic Adaptive Streaming over HTTP) video services. The first is based on the bitrate of the displayed video segments, whereas the second and the third are based on the PSNR and VMAF of each video segment, respectively. The proposed models are compared to the ITU-T standard P.1203 as well as the bitrate-based QoE model proposed by Yin et al. Moreover, the paper presents a subjective study, which confirms the validity of the proposed models. The models are validated by using different DASH adaptation algorithms. In this sense, this paper also presents a DASH ABR (Adaptive Bitrate Streaming) algorithm called Look Ahead, which takes into account the inherent bitrate variability of the video encoding process in order to calculate, in real time, the appropriate quality level that minimizes the number of stalls during the playback.This work is supported by the PAID-10-18 Program and by the R&D Line "Technologies for distribution and processing of multimedia information and QoE'' from the Universitat Politecnica de Valencia.De Fez Lava, I.; Belda Ortega, R.; Guerri Cebollada, JC. (2020). New objective QoE models for evaluating ABR algorithms in DASH. Computer Communications. 158:126-140. https://doi.org/10.1016/j.comcom.2020.05.011S126140158Cisco webpage, Cisco visual networking index: Forecast and trends, 2017–2022 White Paper, Available online: https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11-741490.html. (Accessed September 2019).X. Yin, V. Sekar, B. Sinopoli, Toward a principled framework to design dynamic adaptive streaming algorithms over HTTP, in: Proc. of the 13th ACM Workshop on Hot Topics in Networks, HotNets, Los Angeles, CA, USA, Oct., 2014, pp. 1–7.Barman, N., & Martini, M. G. (2019). QoE Modeling for HTTP Adaptive Video Streaming–A Survey and Open Challenges. IEEE Access, 7, 30831-30859. doi:10.1109/access.2019.2901778Liu, Y., Dey, S., Ulupinar, F., Luby, M., & Mao, Y. (2015). Deriving and Validating User Experience Model for DASH Video Streaming. IEEE Transactions on Broadcasting, 61(4), 651-665. doi:10.1109/tbc.2015.2460611Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J. (2011). Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison. IEEE Transactions on Broadcasting, 57(2), 165-182. doi:10.1109/tbc.2011.2104671Ciubotaru, B., Muntean, G.-M., & Ghinea, G. (2009). Objective Assessment of Region of Interest-Aware Adaptive Multimedia Streaming Quality. IEEE Transactions on Broadcasting, 55(2), 202-212. doi:10.1109/tbc.2009.2020448S. Winkler, A. Sharma, D. Mcnally, Perceptual video quality and blockiness metrics for multimedia streaming applications, in: Proc. of the Int. Symposium on Wireless Personal Multimedia Communications, Aalborg, Denmark, Sep., 2001, pp. 547–552.Bampis, C. G., & Bovik, A. C. (2018). Feature-based prediction of streaming video QoE: Distortions, stalling and memory. Signal Processing: Image Communication, 68, 218-228. doi:10.1016/j.image.2018.05.017Soundararajan, R., & Bovik, A. C. (2013). Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing. IEEE Transactions on Circuits and Systems for Video Technology, 23(4), 684-694. doi:10.1109/tcsvt.2012.2214933A. Raake, M.-N. Garcia, W. Robitza, P. List, S. Göring, B. Feiten, A bitstream-based, scalable video-quality model for HTTP adaptive streaming: ITU-T P.1203.1, in: Proc. of Int. Conf. on Quality of Multimedia Experience, QoMEX, Erfurt, Germany, 2017.W. Robitza, S. Göring, A. Raake, D. Lindegren, G. Heikkilä, J. Gustafsson, P. List, B. Feiten, U. Wüstenhagen, M.-N. Garcia, K. Yamagishi, S. Broom, HTTP Adaptive Streaming QoE Estimation with ITU-T Rec. P.1203 – Open Databases and Software, in: Proc. of the 9th ACM Multimedia Systems Conference, Amsterdam, Netherlands, Jun., 2018, pp. 466–471.X. Deng, L. Chen, F. Wang, Z. Fei, W. Bai, C. Chi. G. Han, L. Wan, A novel strategy to evaluate QoE for video service delivered over HTTP adaptive streaming, in: Proc. of the IEEE 80th Vehicular Technology Conference, VTC2014-Fall, Vancouver, BC, Canada, Sep., 2014.Zegarra Rodriguez, D., Lopes Rosa, R., Costa Alfaia, E., Issy Abrahao, J., & Bressan, G. (2016). Video Quality Metric for Streaming Service Using DASH Standard. IEEE Transactions on Broadcasting, 62(3), 628-639. doi:10.1109/tbc.2016.2570012M.N. Garcia, W. Robitza, A. Raake, On the accuracy of short term quality models for long-term quality prediction, in: Proc. 7th Int. Workshop Qual. Multimedia Exper., QoMEX, Pylos, Greece, 2015.Duanmu, Z., Zeng, K., Ma, K., Rehman, A., & Wang, Z. (2017). A Quality-of-Experience Index for Streaming Video. IEEE Journal of Selected Topics in Signal Processing, 11(1), 154-166. doi:10.1109/jstsp.2016.2608329Bampis, C. G., Li, Z., & Bovik, A. C. (2017). Continuous Prediction of Streaming Video QoE Using Dynamic Networks. IEEE Signal Processing Letters, 24(7), 1083-1087. doi:10.1109/lsp.2017.2705423Winkler, S., & Mohandas, P. (2008). The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics. IEEE Transactions on Broadcasting, 54(3), 660-668. doi:10.1109/tbc.2008.2000733Bampis, C. G., Li, Z., & Bovik, A. C. (2019). Spatiotemporal Feature Integration and Model Fusion for Full Reference Video Quality Assessment. IEEE Transactions on Circuits and Systems for Video Technology, 29(8), 2256-2270. doi:10.1109/tcsvt.2018.2868262Sheikh, H. R., & Bovik, A. C. (2006). Image information and visual quality. IEEE Transactions on Image Processing, 15(2), 430-444. doi:10.1109/tip.2005.859378Li, S., Zhang, F., Ma, L., & Ngan, K. N. (2011). Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments. IEEE Transactions on Multimedia, 13(5), 935-949. doi:10.1109/tmm.2011.2152382Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273-297. doi:10.1007/bf00994018C. Müller, S. Lederer, C. Timmerer, An evaluation of dynamic adaptive streaming over HTTP in vehicular environments, in: Proc. of the 4th Workshop on Mobile Video, MoVid, Chapel Hill, NC, USA, Feb., 2012.P. Juluri, V. Tamarapalli, D. Medhi, SARA: Segment aware rate adaptation algorithm for dynamic adaptive streaming over HTTP, in: Proc. of the IEEE Int. Conf. on Communication Workshop, ICCW, London, UK, Jun., 2015, pp. 1765–1770.Bentaleb, A., Taani, B., Begen, A. C., Timmerer, C., & Zimmermann, R. (2019). A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP. IEEE Communications Surveys & Tutorials, 21(1), 562-585. doi:10.1109/comst.2018.2862938K. Spiteri, R. Urgaonkar, R. Sitaraman, BOLA: Near-optimal bitrate adaption for online videos, in: Proc. of the Int. Conference on Computer Communications, INFOCOM, San Francisco, CA, USA, Apr., 2016.Y. Shuai, T. Herfet, A buffer dynamic stabilizer for low-latency adaptive video streaming, in: Proc. of the Int. Conference on Consumer Electronics, Berlin, Germany, Sep., 2016.Mobile video service performance study, HUAWEI White Paper, available online: http://www.ctiforum.com/uploadfile/2015/0701/20150701091255294.pdf, Published, (Accessed September 2019).C. Bampis, Measuring video quality with VMAF: Why you should care, in: AOMedia Research Symposium, San Francisco, Oct., 2019.Ghadiyaram, D., Pan, J., & Bovik, A. C. (2019). A Subjective and Objective Study of Stalling Events in Mobile Streaming Videos. IEEE Transactions on Circuits and Systems for Video Technology, 29(1), 183-197. doi:10.1109/tcsvt.2017.2768542Tavakoli, S., Egger, S., Seufert, M., Schatz, R., Brunnstrom, K., & Garcia, N. (2016). Perceptual Quality of HTTP Adaptive Streaming Strategies: Cross-Experimental Analysis of Multi-Laboratory and Crowdsourced Subjective Studies. IEEE Journal on Selected Areas in Communications, 34(8), 2141-2153. doi:10.1109/jsac.2016.2577361C. Moldovan, K. Hagn, C. Sieber, W. Kellerer, T. Hoßfeld, Keep calm and don’t switch: about the relationship between switches and quality in HAS, in: Proc. of the Int. Teletraffic Congress, ITC, Genoa, Italy, Sep., 2017